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^ ■ Abstract 

a,: 

Q_i| We discuss how unification of the gauge, Higgs and (three chiral family) matter superfields 

can be realized from the compactification of a six dimensional supersymmetric SU(8) gauge 
theory over the orbifold M 4 x T 2 /Z 3 . The bulk gauge interaction includes Yukawa interactions 
to generate masses for quarks and leptons after the electroweak symmetry is broken. The 
Yukawa matrices in this case turn out to be antisymmetric, and thus not phenomenologically 
viable. To overcome this we introduce brane fields which are vector-like under the standard 
model gauge symmetry, and so do not alter the number of chiral families. In such a setup, the 
observed fermion masses and mixings can be realized by taking into account suppression effects 
from the effective Wilson line couplings and large volume of the extra dimensions. 



1 Introduction 



The discovery of atmospheric and solar neutrino oscillations have yielded convincing evidence 
for new physics beyond the standard model (SM). Many possible extensions of the SM have 
been proposed, and one of the most compelling ideas is quark-lepton unification and that of 
grand unified theories (GUTs) [TJ [2]. Combined with supersymmetry (SUSY), one obtains 
a rather attractive framework for physics beyond the standard model. Gauge couplings can 
be unified in the minimal SUSY standard model (MSSM), and the masses and mixings of 
quarks and leptons can be also explored in a (more or less) unified setup. However, the Higgs 
sector of these theories is usually problematic, leading to well known problems of fine-tuning, 
doublet-triplet splitting, dimension five nucleon decay, etc. 

More recent discussion of SUSY GUTs often invoke one or more extra dimensions to cir- 
cumvent some of these problems. After dimensional reduction, a vector/tensor field in some 
higher dimensional compactified space decomposes into a number of scalar, vector and tensor 
components in four dimensions (4D). The left- and right-handed Weyl fermions in 4D are uni- 
fied in higher dimensional fermions. The idea of compactification has been applied to break 
symmetries via orbifold boundary conditions [HI HI IS]- When applied to GUT models, the 
colored Higgs particles can be projected out, while the unprojected zero mode of the Higgs 
doublet remains light. Dimension five proton decay mediated by the colored Higgs fields is 
forbidden in the model pj. Though the gauge symmetry is explicitly broken by the orbifold 
conditions, the gauge couplings can still unify provided that the brane localized gauge inter- 
actions are suppressed by the large volume of the extra dimension [4]. In such a framework, 
the idea of gauge-Higgs unification [6] was recently revived [7\. The scalar Higgs fields can be 
unified with the gauge fields in some higher dimensional vector field(s). Through the orbifold 
boundary condition, the higher dimensional gauge symmetry gets broken since the generators 
of the associated 4D gauge bosons are projected out. The broken generators for the extra 
dimensional components can have massless modes, and the Wilson line operator can be iden- 
tified as the Higgs bosons breaking the symmetry that remains in 4D [Hj. More precisely, via 
a Hosotani transformation, we can show that the resulting model is equivalent to one with a 
trivial Wilson line and non-Abelian orbifold projections breaking electroweak symmetry. The 
SUSY non-renormalization theorem protects the scalar from acquiring a large mass and which 
therefore survives at low energy. Interestingly, this idea is compatible with the extension of the 
SM to large gauge symmetries including GUTs. 

An interesting consequence of gauge-Higgs unification is that Yukawa interactions can arise 
from the gauge interaction when fermions are also higher dimensional bulk fields [HI HU] . The 
4D zero modes of fermions can be chiral due to orbifold projections, and the higher dimensional 
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extension of the fermion kinetic term with covariant derivative can include Yukawa couplings, 
with some of the higher dimensional components of the gauge fields identified as Higgs fields. In 
the left-right symmetric realization of such a model [IT], the matter representation for achieving 
gauge- Yukawa unification can be much simpler than that of the SM construction, and indeed, 
unification of gauge and Yukawa coupling constants can be realized |10| . In the models over a 
5D Af = 1 SUSY S' 1 /Z 2 orbifold with bulk gauge symmetries such as S'O(ll) and SU(8), which 
break down to S77(4) c x SU{2) L x SU{2) R in 4D, matter fields are unified in hypermultiplets, 
and all three gauge couplings and third generation Yukawa couplings (top, bottom, tau and 
Dirac tau neutrino) can be unified. The top quark mass as well as the MSSM parameter tan/3, 
a ratio of vacuum expectation values (VEVs) for up- and down-type Higgs, are predicted. The 
prediction of the top quark mass is in good agreement with the experiment. Thus, unification 
of the gauge and Yukawa coupling constants can be an important signal of extra dimensions at 
ultra high energy scales [12]. 

In SUSY extensions, the matter fields can be unified in higher dimensional gauge multiplets 
[TBI [14"] . especially if the model consists of N = 4 vector multiplet in 4D language, which can 
arise from 6D M = (1,1) SUSY. Interestingly, three chiral families can be obtained in the case 
of a T 2 /Z 3 orbifold [13]. The three families originate from the three chiral supermultiplets in 
the N = 4 gauge multiplet. Since three is the maximal number of chiral multiplet in 4D, this 
may explain family replication. 

A hypermultiplet in the adjoint representation of the bulk gauge symmetry in 5D Af = 1 
SUSY S 1 /Z 2 orbifold model can be incorporated into the gauge multiplet in 6D Af = (1, 1) 
SUSY orbifold models. In Ref.[15j. it is found that all the matter fields for one family, the 
Higgs doublets, as well as gauge fields of the SM can be unified in 6D Af = (1, 1) SUSY SU(8) 
gauge multiplets with T 2 /Z 6 orbifold. The three gauge couplings and the third generation 
Yukawa couplings can also be unified in the model. Alternative gauge groups [16] and exten- 
sions including seven dimensional models [17j [18] have been discussed. Since no other bulk 
matter fields can be introduced, the model can explain why only the third family is heavy. A 
shortcoming of this type of model is that there is no unique way of specifying the discrete 
orbifold projections so that we get the matter and Higgs fields as the zero modes. The first and 
second families are treated as brane fields to cancel the brane localized gauge anomalies. The 
Yukawa couplings for the first and second families are suppressed by a large volume factor, but 
there is no good reason as to why the mass of the first family is hierarchically small. Thus, the 
masses and mixings are introduced by hand. If the gauge symmetry is extended to a group such 
the SO (16), the two families can be included in the vector multiplet [IB] , though the discrete 
charge assignment is more complicated. 
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If we choose a T 2 /Z 3 orbifold for the SU(8) model, on the other hand, the discrete charge 
assignment is simple and almost unique if N = 1 SUSY survives in 4D. In this case, the three 
chiral families, the Higgs fields as well as the gauge fields are naturally unified in one multi- 
plet. However, the Yukawa matrix is antisymmetric, which stems from the fact that the chiral 
superfields in the gauge multiplet are in adjoint representations of the bulk gauge symmetry. 
As a consequence, after electroweak symmetry breaking, two families have degenerate masses, 
and the first family is massless. One may introduce brane localized interactions to break the 
mass degeneracy through cancellation. This looks not only unnatural, but is also inconsistent 
with the volume suppression of the brane interactions. Without the latter, gauge coupling 
unification can be adversely affected by brane localized couplings. 

In this paper, we will construct a phenomenological viable three-family model from a T 2 /Z 3 
orbifold construction based on SU(8), such that the three chiral families, as well as the gauge 
and Higgs fields are all unified. We will introduce brane localized fields which are vector-like 
under the SM group, and which are needed to cancel the gauge anomalies originating from 
the additional £7(1) gauge symmetries. We will discuss how the second family masses can be 
suppressed due to the large volume of the extra dimensions. The mass of the first family can 
be further suppressed by a mechanism involving Wilson line operators. 

This paper is organized as follows: In section 2, we will construct a 6D Af = (1, 1) SUSY 
T 2 /Z 3 orbifold model with SU(8) bulk gauge symmetry, which breaks down to TV = 1 SUSY 
with SU(A) C x SU(2) L x SU{2) R x U{lf at the 4D fixed points. The three chiral matter 
multiplets of the SM and the Higgs fields are obtained from the bulk gauge multiplet. The 
Yukawa and gauge interactions are unified. In section 3, we study how the fermion mass 
hierarchy can be realized. Section 4 explores fermion masses and mixings in more detail. Our 
conclusions are summarized in Section 5. 

2 Gauge, Higgs and Three-Family Unification 

In this section we will construct a model in which the 4D gauge, Higgs superfield and three 
families of matter superfield are unified in a 6D Af = (1,1) SUSY gauge (super) multiplet 
associated with the gauge group G = SU(8). The gauge multiplet consists of a vector field, 
four real scalars, and both left- and right-handed Weyl fermions. The maximal i?-symmetry in 
Af = (1, 1) SUSY is Sp(2) L x Sp(2) R . The vector field is a singlet under the i?-symmetry and 
decomposes into a 4D vector field and two real scalar fields A 5 and A 6 . The four real scalars 
in the gauge multiplet transform as (2, 2) under the i?-symmetry, while the left(right)-handed 
Weyl spinors transform as (1, 2) ((2, 1)). From a 4D point of view, there are four left-handed 
Weyl spinors. All together, these fields are reorganized in a single N = 4 gauge multiplet, 
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which consists of one N = 1 vector superfield V and three chiral superfields $j (i = 1,2,3) 
in 4D. The scalar component of $1 is A 5 — iA & . [The formalism of 6D models is described in 
Ref.[IH].] 

The two extra dimensions are compactified over a flat T 2 /Z3 orbifold. The orbifold trans- 
formation R is z — > toz, where z = x$ + ix§ and u = e 2nl ^ 3 . The transformation R can also 
act on the internal symmetry of the Lagrangian, which in our class of models is the product of 
Sp(2) L , Sp(2) R and Aut{G). This extension of R can break SUSY as well as the bulk gauge 
group G. Depending on the discrete charge assignment, the 4D N = 4 SUSY can be broken 
down to N = 0, 1 or 2. 

If at least N — 1 SUSY survives at a 4D fixed point, the orbifold conditions for the superfields 
V and $i are 

V(af,wz,wz) = UV(x^,z,z)U-\ (1) 
Q^af^^uz) = OU^ 1 (x fl ,z,z)U~ 1 , (2) 
$ 2 (/,u2,u2) = u l U$ 2 (x?,z,z)U- x , (3) 
$ 3 (x»,wz,wz) = uTU^zixf^z)^ 1 , (4) 

where U is an SU (8) matrix. Since there are higher dimensional versions of the gauge interaction 
term tr $i [$ 2 , ^3] i n the Lagrangian, the condition 1 + 1 + m = (mod 3) needs to be satisfied. 
The only possible choices are (l,m) = (1, 1), (2,0), (0,2). For the case (l,m) = (2,0), $1 and 
$2 form a hypermultiplet, and V and $3 form an N = 2 vector multiplet. In the same way, 
N = 2 SUSY remains for (l,m) = (0,2). Thus, (l,m) = (1, 1) is the unique choice to obtain 
N = 1 SUSY at the 4D fixed points with the orbifold conditions on all three chiral superfields 
being the same. We will choose I = m = 1 hereafter. 
The SU(8) matrix U is chosen to be 

U = diag(l, 1, 1, 1, cu, ou, u, w), (5) 

resulting in the breaking of the SU(8) gauge symmetry to G 42 2 x U{1)a X U(1)b in 4D, where 
G422 is the gauge symmetry SU(4) C x SU{2) L x SU{2) R PQ. The SU(8) adjoint representation 
63 decomposes as 

/ (15,l,l)o,o (4,2,l) w (4,1,2)!,! \ 
63^ (4,2,l)_i,i (l,3,l)o,o (1, 2, 2)0,2 ©(1,1, l)o,o 0(1,1, l)o,o, (6) 
V (4,l,2)_ w (l,2,2)o,-2 (l,l,3)o,o / 

where the generators of U(1)a and U(1)b subgroups are chosen and normalized to be 
diag (1, 1, 1, 1, — 1, — 1, — 1, — 1)/2 and diag (0, 0, 0, 0, 1, 1, — 1, — 1), respectively. Although the 
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representations are vector-like under the subgroup, the zero modes of the superfields are 
chiral after orbifold projection, and thus a chiral field theory in 4D is obtained. The zero 
modes correspond to three copies of (4, 2, 1)1,-1 an d (4, 1, 2)_i i _i representations, and also 
three copies of (1,2, 2) 0) J3- These can be interpreted as the SU{2)l (SU(2)r) doublet matter 
chiral superfields for quarks and leptons, and the Higgs bidoublets Hi, respectively. As 

a result, the gauge and Higgs fields as well as the three families of SM matter fields plus three 
right-handed neutrinos are unified in one gauge multiplet. 

There is only one pair of Higgs doublets in the MSSM. Indeed, if more than two pairs of 
doublets survive well below the unification scale, they can spoil gauge coupling unification. The 
brane interaction of Hi with the G422 singlets can make two of the bidoublets massive, so that 
only one linear combination remains light. 

It is worth noting that obtaining the three chiral families does not depend on the details 
of the discrete charge assignments. Three copies of chiral fields are always obtained if N — 1 
SUSY remains in 4D. The converse of this statement also holds. 

Due to the SU(8) bulk gauge unification, the SU(4) C , SU{2)l and SU{2)r gauge couplings 
from a 4D point of view are unified at the cutoff M* [H [20] , 

2 "2 

„2 _ 2 2 _ 2 _ 96D_ _ 9&D m 

i/c _ i/2L _ iJ2R — iJ — y — yjy[2 ' V 1 

where V is the volume of the extra dimensions. The 6D gauge coupling g^p is a dimensionful 
parameter, which can be turned into a dimensionless coupling c/qd by employing the cutoff M*. 
A brane localized gauge kinetic term can modify this unification, but this can be suppressed if 
VMl is sufficiently large. 

Since the scalar component of $1 is a higher dimensional gauge field, the bulk gauge inter- 
action includes the term tr $i[$2, ^3], which contains the Yukawa couplings, 

geijk^^Hk, (8) 

with conventional normalization of the gauge coupling, tr T a T b = 1/2 5 ab , the bulk Yukawa 
coupling constant is the same as the gauge coupling g. 

Because the chiral superfields are in the adjoint representation, the bulk Yukawa coupling 
is antisymmetric. One family is naturally predicted to be massless, which, to a good approxi- 
mation, is desirable as far as the first generation is concerned. However, the two non-zero mass 
eigenvalues of the fermions are degenerate, which is a terribly wrong prediction. Although a 
brane localized interaction, y'^^i^/^Hk, may be introduced to solve the problem, such interac- 
tions are suppressed by the volume factor. This suppression is needed, as previously mentioned, 



1 Note that the Higgs bidoublet is also chiral with respect to one of the U(l) symmetries. 
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to preserve gauge coupling as well as gauge- Yukawa unification. In addition, the fermion mass 
hierarchy between the second and third families would then arise from fine-tuning, which is 
not attractive. In the next two sections we will show how phenomenologically viable fermion 
masses and mixings can be achieved in this class of models. 



3 Fermion Mass Hierarchy 



We have three chiral families ^ (4, 2, l)i _i, *f (4, 1, 2)_i _j and Hi (1, 2, 2) 0j2 from the zero 
modes. There are gauge anomalies at each 4D fixed point |21j involving the U(l) symmetries. In 
order to cancel these anomalies and retain three chiral families, we introduce brane fields which 
are vector-like under G422 but not with respect to the C/(l)'s. To break the U(l) symmetries, 
some G422 singlet fields with suitable U(l) charges are also introduced. 

Suppose that brane superfields (4, 1,2), and (4, 1, 2) are introduced with the following 
interaction: 

J d 6 x S(x 5 )8(x 6 ) J d 2 9 (M%{% + r$>1) + Vik %^ c b H k ) . (9) 

The mass scale M may be related to the U(1)a,b breaking scale. The fermion mass matrix 
(e.g. for up-type quark) is given by 



u x u 2 u 3 VI 



( a 3 -a 2 mi \ 

— a 3 d\ m 2 

a 2 — Oi m 3 

\ r x M r 2 M r 3 M M J 



( u\\ 

u c 2 



Un 



(10) 



where = g(H® u ) and m ; = yik(H® u ). If there is no other up-type Higgs field with a large VEV, 

1 /2 

we have a = {a\ + a\ + a|) = gv u . We neglect the brane localized coupling y'^^ i^H^. 
Due to volume suppression, y ik is suppressed, and thus a. For the same reason, the 

dimensionless coefficients r.; ^> 1. Without loss of generality, the a 2 , a 3 and r 3 entries can be 
eliminated by the transformations = Vij^j and ijff = Vij^^, where V is a unitary matrix. 
Thus, we can write the up-type quark mass matrix as 



/ 











m' x 












a 


m 2 









—a 





m' 3 




\ 


r[M 


r' 2 M 





M 


J 
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With M ^> v U7 the mass eigenvalues can be calculated to be 

m 2 u m 2 c m 2 t = -jj-^, (12) 
1 + r z 

mlml + m>? + mfr? = , 2 <" + + ff? + ri2( " 2 + , (13) 

+ ml + m\ = a 2 + ( a + r 2'"s) 2 + r ? (™f + ™?) + r f (° 2 + ™ 2 ) _ (14) 

1 + H 

where r 2 = r\ + r| + r| and m 2 = m 2 + m 2 , + mf. Therefore, under the assumption of volume 
suppression (a 3> m and r ^> 1), the quark masses are hierarchical if r[ <C r is satisfied and 
one finds 

a , r\ m\ _ 

nit — a, m c ~ — h m 3 , m u ~ a . (15) 

r r m c 

For this case, the top, bottom, tau (and also Dirac tau neutrino) Yukawa couplings are unified 
at the GUT scale together with the gauge coupling: 

9c = 92L = 92R = Vt = yb = Vr = Vv T - (16) 

The scalar components of and as well as of Hi, are identified with the transverse 
components A z of the gauge field. Because A z can always be gauged away on the branes, it 
is not possible to introduce brane couplings to the zero modes of the first family. In the limit 
when there is no brane interactions for ty\ and Hi, we obtain 02,03, mi — ► and r\ — > 0. 
The first generation is then massless, while the second and third family masses are hierarchical. 

Since the first family is not truly massless we need a small correction to the brane coupling. 
There could exist a gauge invariant coupling involving a Wilson line closed path with a nontrivial 
winding number around the torus. This coupling is expected to be exponentially suppressed 
[22| [23] , which could provide an explanation of the observed suppression of the first family mass 
terms [21] . 



4 Fermion Masses and Mixings 

In the previous section we have seen how a fermion mass hierarchy can be realized through 
suppression of the Wilson line couplings and from volume suppression. In this section we discuss 
the Yukawa matrices in more detail. Since a left-right symmetry survives at 4D fixed points, 
the quark CKM mixings vanish if only one bidoublet is light, which is assumed for successful 
gauge coupling unification. Though it is an attractive feature at leading order, we have to break 
the proportional relationship between the up- and down-type quark mass matrices, as well as 
lepton Dirac mass matrices, to obtain realistic quark and lepton masses and mixings [25] . 
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In our setup, the breaking of G422 down to the SM can happen by the VEVs of brane fields, 
which can break the proportional relationship of the fermion mass matrices. For example, 
suppose that there is a nonrenormalizable coupling, E^^S/M*, in addition to the coupling 
^i^lS, where S is a singlet under G422 with appropriate U(l) charges to make the coupling 
gauge-invariant and S is a triplet under SU(2)r. Then, n in the fermion mass matrix such as 
Eq. lflQl) can be slightly different for up- and down- type quarks. There is enough freedom to 
fit fermion masses and mixings if we include this type of couplings with ,S77(4) C and SU(2)r 
adjoint fields. 

Consider one such modification with (r 3 /r 2 ) u = 1 + 5/2 and {r3/r 2 ) d = 1 — 5/2 for example. 
Then, in the basis used in Eq.f llll) . the quark mass matrices can be written as 



/ 











m\ 


\ 










a-u 











Q"u 





fflj 




V 




r u M 





M 


) 



( 



M, 
















a d 




m 
m 2 
mi 



n 



(17) 



\ e d r d M' r d M' 5r d M' M' J 
Integrating out the heavy vector-like quark fields, we obtain 



M. 



3x3 




M 3X3 















ttrf 

rd 


+ 


5a c 







rd 


a d 



The bulk field for the right-handed second family is switched into the bulk field ^ in the large 
r U)d limit. In the expression for 3x3 mass matrices, the second and third rows are switched. 
It is easy to find that V c b — 5, and one can also fit the relations V u b ~ V us V c b and V c b ~ m s /m b . 
The (1,1) elements in the quark mass matrices are tiny since the effective Wilson line coupling 
is suppressed. This is useful to explain the empirical relation V us ~ \Jm d /m s . The hierarchy 
within the up- and down-type quarks, e.g. m u /m t m d /mt ) , is not explained in this model. 

For the neutrino sector, the nonrenormalizable coupling ^1^ c -x c X c is needed to obtain heavy 
right-handed Majorana masses. The brane field \ c transforms as (4,1,2) under G^- The 
observed bilarge neutrino mixing is not automatically realized in the model, but there is enough 
freedom to fit the neutrino data. The large (essentially maximal) atmospheric neutrino mixing 
may be explained by the choice r 2 ~ r 3 . The model displays antisymmetry to leading order 
under the exchange of $2 and $3, which is related to the Sp{2)^ symmetry in the bulk. As in the 
quark sector, due to the left-right gauge symmetry, the mixing angles from the neutrino Dirac 
sector are effectively small in the basis where the charged-lepton Yukawa matrix is diagonal. 
Namely, even if r 2 ~ r%, a large mixing in the charged-lepton Yukawa matrix is essentially 
canceled by the mixing in the Dirac neutrino Yukawa matrix. When considering type I seesaw, 
the observed large mixing needs to be generated by suitably choosing the right-handed Majorana 
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mass matrix, irrespective of the symmetry. If we consider type II seesaw [26], on the other 
hand, there is no reason to cancel the large mixing in the charged-lepton Yukawa matrix and 
the exchange symmetry between <3> 2 and $3 can be the origin of the large atmospheric neutrino 
mixing. 

5 Conclusion and Discussion 

We have studied a 6D Af = (1, 1) SUSY model with 577(8) bulk gauge symmetry compactified 
over a flat orbifold T 2 /^. The SU(8) symmetry is broken through orbifold compactification to 
S77(4) c x SU(2) L x SU(2) R x U(1) A x U(1) B . The three chiral families of the SM together with 
three right-handed neutrinos, as well as Higgs fields, are the zero modes. Thus, gauge, Higgs 
and matter fields of the SM are unified in a single gauge supermultiplet in higher dimension. 
However, this leads an antisymmetric Yukawa coupling matrix for the three chiral families. As 
a consequence, two of the fermion mass eigenvalues are degenerate, which is not acceptable. To 
solve this problem, one could consider the orbifold T 2 /Z 6 [15], so that the undesired eigenstate 
is projected out, only one family arises from the bulk fields, and the third family Yukawa 
couplings are unified with the gauge couplings. In this paper, on the other hand, we have 
constructed a realistic model employing brane localized fields which form vector-like pairs under 
the SM. Being vector-like, these fields do not alter the number of chiral families. In this setup, 
the fermion mass hierarchy can be realized as a result of suppression of the effective Wilson 
line couplings as well as the large volume of the extra dimensions. The third family Yukawa 
couplings maintain their asymptotic unification with the gauge couplings. Ignoring threshold 
effects at both the unification and weak scales yields m t = 178 GeV and tan/? = 51 [T2l 127] . 

While SU(8) was employed to construct our model, we briefly comment on other choices for 
the bulk gauge group. We find that except for SU(8), a complete set of three chiral quark and 
lepton families as well as Higgs fields is hard to achieve for a T 2 /Z 3 orbifold. In some cases, the 
SM particles are partially included in the bulk fields, while in some other cases, more than three 
chiral families are included in the bulk fields and a flavor gauge symmetry survives in 4D. In 
the latter case, it seems better to work with the T 2 /Z 6 orbifold. If the bulk fields only partially 
include the SM matter fields, the other remaining chiral fields are brane localized fields. In such 
partially unified models, only the top quark Yukawa coupling can be unified with the gauge 
couplings, and this may help explain the up-down hierarchy such as m u /m t <C m^/m^. 
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